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A system (10) for reading package information 
includes an imaging system (12) and a label decoding 
system (14). The imaging system (12) captures an 
image of a package surface (34) that includes a machine 
readable code such as a bar code (36) and an alphanumeric 
destination address (38). The label decoding system (14) 
locates and decodes the machine readable code and uses 
OCK techniques to read the destination address (38). The 
destination address is validated by comparing the decoded 
address to a database of valid addresses. If the decoded 
address is invalid, an image of the destination address is 
displayed on a workstation (30) and an operator enters the 
correct address. The system (10) forms a unified package 
record by combining the decoded bar code data and the 
correct destination address data. The unif)ed package 
record is used for subsequently sorting and tracking the 
package (20) and is stored in a database and applied to a 
label that is affixed to the package (20). 
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"SYSTEM AND METHOD FOR 
READING PACKAGE INFORMATION ' 

10 

Technical Field 

The present invention relates to package tracking systems, and 
more particularly relates to systems for automatically reading and decoding 
package information such as machine readable codes and alphanumeric 
1 5 destination information . 

Background of the Invention 

Small package delivery companies such as the assignee of the 
present invention may handle as many as several million packages each day. In 

20 order to improve the efficiency and accuracy with which this volume of 
packages is handled, these companies mcreasingly rely on automated package 
soning and routing facilities. Small package delivery companies also desire to 
obtain package related information in order to better manage their operations and 
to provide a variety of shipping related information to their customers. 

25 The process of sorting and tracking packages as they proceed 

through a package transportation system requires that each package bear two 
types of information. First, each package must provide a destination address. 
Second, each package must include a tracking number that uniquely identifies it 
from other packages in the system. 

30 The destination address is required in order for the package 

delivery company to know where the package is going. The destination 
address, which includes alphanumeric text, is typically written on the package 
or printed on a label that is affixed to the package. For addresses in the United 
States, the destination address includes a street address, city, state and zip code. 

35 The tracking number, which consists of a series of alphanumeric 

characters, uniquely identifies each package in the package transportation 
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system. In most cases, the tracking number is affixed to the package in the 
form of a machine readable code or symbol such as a bar code. The machine 
readable code is read by electronic code readers at various points in the 
transportation system. This allows the package delivery company to monitor 
5 the movement of each package through its system and to provide customers 
with information pertaining to the status and location of each package. 

The importance of collecting package related data has led to the 
development of a variety of devices for reading bar codes and other machine 
readable codes. These devices include hand held readers used by employees 

10 when they pick up or deliver packages, and over-the-beli cameras that are 
mounted over conveyor belts in order to read machine readable codes as the 
packages move through the delivery company's terminal facilities. 

In some cases, shippers may also print and affix labels including 
two-dimensional machine readable codes that include both package identification 

15 information and destination address information. These dense codes are read by 
over-the-belt cameras and the information is used to track and sort the package. 
However, for packages that enter the delivery company's system without such 
labels, there is no efficient, automatic way to prepare such labels and affix them 
to packages. 

20 Optical character recognition (OCR) technology has also 

improved to the point where it is feasible to automatically read and decode 
printed destination address data. The assignee of the present invention has 
developed over-the-belt camera systems that can be used to capture and decode 
bar codes and text as packages travel beneath the camera on a conveyor belt. 

25 The ability to read and decode destination address data is useful because it 
facilitates automatic sorting and routing of packages in the delivery' system. 

Although OCR systems are becoming more common, there are 
often difficulties associated with decoding data from packages moving on a 
conveyor belt at a high rate of speed. Current bar code decoding techniques 

30 provide for using a variety of algorithms for scanning an image and locating and 
decoding a bar code. These techniques are very accurate, in part because of the 
use of checksums and other techniques to ensure the reliability of the bar code 
decoding process. OCR techniques typically apply a variety of decode 
algorithms to a string of text in order to accurately decode the text. However, 

35 there remains the possibility that the address data may be improperly decoded. 
Furthermore, it is difficult to detect an improperly decoded address because 
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OCR decoding does not employ checksums and other techniques that are 
available to verify the accuracy of machine readable codes. 

Therefore, there is a need in the art for a system that reads and 
decodes bar codes and text, and which verifies the accuracy of the destination 
5 address data. Furthermore, there is a need for a system that provides a method 
for correcting improperly decoded destination address data, and for combining 
the destination address data and the decoded bar code data to form a unified 
package record, which may be used to track and sort the package as it moves 
through the package delivery system. 

10 

Summary of the Invention 

The invention seeks to provide a system that reads and decodes 
all relevant package data from a package, that verifies the accuracy of the 
decoded package data, that facilitates the correction of incorrectly decoded 
15 package data, and that provides a unified package record including relevant 
package data. 

In accordance with the invention, this object is accomplished in a 
method for reading package information from a package that includes first and 
second information indicia. The method includes capturing an image of the 

20 package, including the first and second information indicia. The first 
information indicia is located and decoded to provide first package data. The 
second information indicia is located and decoded to provide second package 
data. The first and second package data are then combined to form a unified 
package record. The unified package record may be stored in a database or 

25 printed on a label and affixed to the package. 

The invention further provides a method for reading and 
verifying package information from a package. The method includes capturing 
an image of the package, which includes information indicia. The information 
indicia is located and decoded to provide first package data. The first package 

30 data is verified to determine whether it is valid. If not, the image of the 
information indicia is displayed on a workstation. Manually entered first 
package data is then received from an operator at the workstation. 

A system and method for reading package information formed in 
accordance with the invention has a number of advantages. A package bears at 

35 least one label that includes information indicia such as a destination address and 
a machine readable symbol (for example, a bar code or two-dimensional dense 
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code) bearing a package identification number. As packages move along a 
conveyor belt, an image of each package is captured and the indicia are decoded. 
The decoded destination address is validated by checking a database of valid 
addresses. If the decoded address is invalid, an image of the address is 
5 displayed on an image display workstation, and an operator enters the correct 
destination address. The symbol data and destination address are combined to 
form a unified package record, which may be used to sort and track the 
package. The unified package record may be stored in a database or printed on 
a label and affixed to the package. 

10 

Brief Description of the Drawings 

Fig. 1 is a block diagram of a system for reading package 
information in accordance with the present mvention. 

Fig. 2 is a diagram of a parcel including a fluorescent ink 
15 fiduciary mark located within the destination address block of the parcel. 

Fig. 3 is a flow diagram of the process for reading package 
information carried out by the system of Fig. 1. 

Fig. 4 is a flow diagram of the preferred method for processing 
image data provided by the imaging system that forms a part of the system of 
20 Fig. 1. 

Fig. 5 is a flow diagram of the preferred method for correcting 
incorrectly decoded destination address data. 

Detailed Description of the Preferred Embodiment 

25 The present invention provides a novel system and method for 

reading package information. Generally described, the system includes an 
imaging system that provides a digital image of a surface of a package that is 
moving on a conveyor belt. The image includes a bar code and destination 
address that are provided on the package surface. A label decoding system 

30 processes the image from the imaging system and decodes the bar code and the 
destination address data. The destination address data is validated by checking 
the address against the United States Postal Service's ZIP+4 database, which 
contains all of the valid addresses in the United States. If the destination 
address was decoded incorrectly, the portion of the image that includes the 

35 destination address is displayed on an image display workstation, along with a 
list of possible addresses from the database. An operator reads the destination 
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address data from the display and manually enters it into the computer terminal 
or selects the correct address from a displayed list of possible addresses. After 
the destination address has been validated or manually entered, the bar code data 
and destination address data are combined to form a unified package record, 
5 which provides efficient means for automatically tracking and sorting packages. 
This data may be stored in a database or printed on labels and affixed to the 
package. 

Before describing the present invention in additional detail, it is 
useful to discuss the nomenclature of the specification. Portions of the detailed 

10 description that follows are represented largely in terms of processes and 
symbolic representations of operations performed by computer components, 
including a central processing unit (CPU), memory storage devices for the 
CPU, and connected display devices. These operations include the 
manipulation of data by the CPU and the maintenance of these data within data 

15 structures resident in one or more of the memory storage devices. The symbolic 
representations are the means used by those skilled in the art of computer 
programming and computer construction to most effectively convey teachings 
and discoveries to others skilled in the art. 

For the purposes of this discussion, a process or portions 

20 thereof may be generally conceived to be a sequence of computer-executed steps 
leading to a desired result. These steps generally require physical manipulations 
of physical quantities. Usually, though not necessarily, these quantities take the 
form of electrical, magnetic, or optical signals capable of being stored, 
transferred, combined, compared, or otherwise manipulated. It is conventional 

25 for those skilled in the art to refer to these signals as bits, values, elements, 
symbols, characters, terms, objects, numbers, records, files or the like. It 
should be kept in mind, however, that these and similar terms should be 
associated with appropriate physical quantities for computer operations, and that 
these terms are merely conventional labels applied to physical quantities that 

30 exist within and during operation of the computer. 

It should also be understood that manipulations within the 
computer are often referred to in terms such as adding, comparing, moving, etc. 
which are often associated with manual operations performed by a human 
operator. In most cases, it will be apparent that these steps are performed by a 

35 computer without requiring input from an operator. In some cases, the 
operations described herein are machine operations performed in conjunction 
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with a human operator that interacts with the computer. The machines used for 

performing the operation of the present invention include general purpose digital 

computers or other similar computing devices. 

In addition, it should be understood that no particular 
5 programming language is provided, and that the programs, processes, methods, 

etc. described herein are not limited to any particular computer or apparatus. 

Those skilled in the art will appreciate that there are many computers and 

operating systems which may be used in practicmg the mstant invention and 

therefore no detailed computer program could be provided which would be 
10 applicable to these many different systems. Each user of a particular computer 

or operating system will be aware of the program modules and tools that are 

most appropriate for that user's needs and purposes. 

Referring now the drawings, in which like numerals represent 

like elements throughout the several figures, the present invention will be 
15 described. 

The System for Reading Package Information 

Fig- 1 illustrates a system 10 for reading and decoding package 
information as packages travel on a conveyor belt. The system 10 includes an 

20 imaging system 12 and a label decoding system 14. Generally described, the 
preferred imaging system 12 is a two-camera system that includes a high 
resolution over-the-belt (OTB) camera 16 and a fiduciary mark detector 24, 
which includes the second camera. The high resolution OTB camera 16 and 
fiduciary mark detector 24 are mounted above a conveyor belt 18 that carries 

25 packages 20a-c in the direction of arrow 22. Together, the high resolution 
OTB camera 16 and fiduciary mark detector 24 ascertain the position and 
orientation of a fluorescent ink fiduciary mark located within a destination 
address block on the surface of a package, capture an image of the top surface 
of the package, and provide the image and the location and orientation of the 

30 fiduciary mark to the label decoding system 14. The label decoding system 14 
includes general purpose and high performance computers and data storage 
facilities. The label decoding system 14 is connected to an image server 29. 
which is connected to at least one image display workstation 30a-c, and to a 
label printer 32. The label decoding system 14 locates and decodes machine 

35 readable package identification data (e.g., a bar code) and destination address 
data contained in the image. This package identification data and destination 
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address data are combined to form a unified package record, which may be 
stored in a database or printed in machine readable form on a label and affixed to 
the package. 

Fig. 2 illustrates the top surface 34 of a package 20 that is 
5 processed by the preferred system 10. The top surface 34 of each package 20 
includes package tracking information in the form of a machine readable code or 
symbol such as a bar code 36. The package tracking information represented 
by the bar code uniquely identifies the package and distinguishes it from the 
other packages in the delivery system. The top surface of the package also 

10 includes a destination address 38, which typically consists of alphanumeric text 
arranged in two or more lines. The destination address 38 is located in an area 
referred to as the destination address block 40. A fiduciary mark such as 
fluorescent ink fiduciary mark 42 is located approximately in the center of the 
destination address block 40 in the same area as the text defining the destination 

15 address. The fiduciary mark 42 is applied to the destination address block 40 
by the shipper or by an agent of the small package delivery company. This may 
be accomplished by using a rubber stamp in the shape of the desired fiduciary 
mark to apply fluorescent ink to the package surface. Those skilled in the art 
will appreciate that other types of fiduciary marks may be used. 

20 Referring again to Fig. K the components and operation of the 

imaging system 12 and the label decoding system 14 will be described in 
additional detail. In addition to the high resolution OTB camera 16 and 
fiduciary mark detector 24, the imaging system 12 includes a package height 
sensor 26, and an illumination source 28. As packages are transported by the 

25 conveyor belt 18 the packages 20a-c first pass under the fiduciary mark 
detector 24, which detects a fiduciary mark in order to determine the location 
and orientation of the destination address block. The package height sensor 26 
is a commercially available light curtain, and is used to determined the height of 
the package before it passes beneath the high resolution OTB camera 16. The 

30 height information from the height sensor 26 is used by the high resolution 
camera's focusing system. This permits the high resolution camera 16 to 
accurately focus on the top surface of the package 20c as it moves beneath the 
camera. The illumination source 28 illuminates the top surface of the package 
20c as it passes beneath the high resolution camera 16, The location and 

35 orientation information are provided to the label decoding system 14 along with 
the image from the high resolution camera 16. 
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The conveyor belt system is used to transport packages through 
a terminal facility. In the preferred system 10, the conveyor belt 18 is 16 
inches wide and carries up to 3,600 packages per hour while moving at a rate of 
up to 100 feet per minute. The packages 20a-c var\' in height and may be 
5 arbitrarily oriented on the conveyor belt 18. The conveyor belt 18 moves each 
package beneath the fiduciary' mark detector 24 and high resolution camera 16 
in single file, and with some amount of space between them. The packages are 
separated by a device known as a singulator. A suitable singulator is described 
in U.S. Patent No. 5,372,238 lo Bonnet, entitled "Method and Apparatus for 

1 0 Singularizing Objects." 

The conveyor bell 18 includes a belt encoder 44 thai is used to 
determine the speed and position the associated conveyor belt. Those skilled in 
the art will appreciate that the speed and position of the conveyor are needed in 
order to synchronize the position of the fiduciary mark, the package height 

15 information, and the position of the package as it passes beneath the high 
resolution camera 16. The belt encoder supplies a signal indicating the speed of 
the conveyor 18 to the fiduciary mark detector 24 and the high resolution 
camera 16. The signal from the encoder is used to produce a line clock signal 
that is used to trigger cycles of the fiduciary mark detector's low resolution 

20 camera (i.e., exposures of the line of CCD pixels comprising the low resolution 
camera). Each cycle captures a row of the image of the surface of a parcel as it 
moves past the fiduciary' mark detector 24, The belt encoder 44 is selected to 
provide a pulse for each cycle of the high resolution camera 16. Those skilled 
in the art will appreciate that the signal from the encoder allows the line images 

25 captured by the fiduciary mark detector 24 and high resolution camera 16 to be 
assembled by the label decoding system 14 into two-dimensional images with 
the correct aspect ratios. A more detailed description of the interaction between 
an OTB camera, conveyor belt, height information processor, and belt encoder 
is provided in U.S. Patent No. 5,291,564 to Shalu entitled "System and 

30 Method for Acquiring an Optical Target," which is incorporaied herein by 
reference. 

A suitable fiduciary' mark detector is described in pending U.S. 
Application No. 08/419,176. filed April 10, 1995, and entitled ^'Method for 
Locating the Position and Orientation of a Fiduciary Mark," which is assigned 
35 to the assignee of the present invention and is incorporated herein by reference. 
The fiduciary mark detector 24 includes a low resolution CCD camera, a video 
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processor, and an ultraviolet light source for illuminating the fluorescent ink that 
forms the fiduciary mark. The conveyor belt 18 moves a package 20a through 
the field of view of the low resolution CCD camera. The video processor 
controls the operation of the low resolution camera and sequentially transmits a 
5 one-bit (i.e., black/white) video signal corresponding to the image captured by 
the low resolution camera to the label decoding system 14. The preferred low 
resolution camera is a low resolution, monochrome, 256 pixel line-scan type 
camera such as a Thompson TH7806A or TH7931D. The ultraviolet light 
source illuminates the package 20a as it is conveyed through the viewing area of 

10 the low resolution camera, which captures an image of the surface of the 
package 20a. The low resolution camera is fitted with a commercially available 
optical filter that transmits yellow/green light such as that emitted by fluorescent 
ink exposed to ultraviolet light and attenuates light in other portions of the 
visible spectrum. The low resolution camera is thus configured to be 

15 responsive to the yellow/green light emitted by the illuminated fiduciary mark, 
and not to the other indicia found on the package surface. More specifically, the 
optical filter causes the low resolution camera to be responsive to the 
yellow/green light emitted from the commercially available National Ink No. 35- 
48-J (Fluorescent Yellow) in response to ultraviolet light. 

20 Referring again to Fig. 2, the preferred fiduciary mark 42 will 

be described in additional detail. The preferred fiduciary mark 42 comprises 
two fluorescent non-overlapping circles of different diameter. As used herein, a 
circle means either an annulus or the area bounded by an annulus. The fiduciary 
mark 42 includes a large circle and a small circle oriented such that a vector 

25 from the center of large circle to the center of the small circle is oriented 
approximately in the same direction as underlying text of the destination address 
38. The position of the fiduciary' mark 42 is defined to be the mid-point of the 
vector. It will be clear to those skilled in the art that alternative embodiments 
might include locating the fiduciary mark elsewhere on the parcel in a known 

30 relation to a text bearing area, or in a different known relationship to the 
underlying text. The fiduciary mark 42 is typically applied to a parcel using a 
conventional rubber stamp and fluorescent ink after the destination address 38 
has been affixed to the parcel. It will be appreciated that the fiduciary mark 42 
might be carried on a label, preprinted upon the parcel, or might be carried upon 

35 a transparent envelope into which an address label is placed. 
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For the preferred fiduciary mark 42, the diameter of the large 
circle is approximately 3/4 of an inch, the diameter of the small circle is 
approximately 7/16 of an inch, and the distance separating them is 
approximately 1/4 of an inch. It is noted that a limit is imposed upon the size of 
5 the fiduciary mark 42 by the resolution of the low resolution camera that forms 
a part of the fiduciary mark detector 24. For example, the fiduciary mark 42 
may be made smaller if the low resolution camera has a higher resolution, and 
the resolution of camera may be reduced if the fiduciar\' mark is made larger. 

Those skilled in the art will appreciate that a fiduciary^ mark can 

10 be any mark that identifies the location of the destination address and that the 
preferred fiduciary mark comprising two circles is simply one of a variety of 
possible choices. Those skilled in the an will also appreciate that although the 
preferred fiduciary mark indicates the location and orientation of the destination 
address it is possible to use a fiduciary mark that indicates only location. In 

15 such a case, the orientation would be determined by applying an appropriate 
processing technique to the image of the destination address block. 

The preferred system 10 also defines a region of interest defined 
with respect to the fiduciar>^ mark 42. The region of interest is defined in terms 
of the high resolution camera to be a Ik by Ik square (i.e., 1,024 pixels by 

20 1,024 pixels, which is equivalent to approximately four inches by four inches) 
centered on the defined position of the fiduciary mark 42. The label decoding 
system 14 determines the position and orientation of the fiduciary mark 42 and 
defines the region of interest with respect to the position of the fiduciary mark 
42. The label decoding system then creates and stores a high resolution text 

25 image within the region of interest from the data captured by the high resolution 
camera 16. In this manner, only a relatively small portion of the data captured 
by the high resolution camera 16 is processed in order to decode the destination 
address data. 

The package height sensor 26 is a commercially available light 
30 curtain, and is used to determined the height of the package before it passes 
beneath the high resolution OTB camera 16. The height information from the 
height sensor 26 is used by the high resolution camera's focusing system. 

The preferred illumination source 28 includes an unsymmetrical 
elliptical reflector. The reflector is shaped by first and second elliptical surfaces. 
35 The first and second elliptical surfaces share a common first focus, along which 
the light source is located. The first and second elliptical surfaces have different 
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second foci. Thus, half of the elliptical surface concentrates the light at one 
level and the other half concentrates the light at a second level. Together, the 
first and second elliptical surfaces develop intense illumination between their 
respective second focal axes, 
5 The high resolution camera 16 is preferably a monochrome, 

4,096 pixel line-scan type camera such as one using a Kodak KLI-5001 CCD 
chip. Each pixel measures approximately 7 microns x 7 microns. The CCD 
array is sufficiently wide to scan the entire width of the conveyor belt. The 
image of the package is captured one *'slice'' at a time as the package moves 

10 beneath the camera. The high resolution camera 16 transmits an eight-bit gray- 
scale video signal corresponding to the captured image to the label decoding 
system 14. Illumination source 28 provides bright white light in order to 
illuminate the package as it is conveyed through the viewing area of the high 
resolution camera 16, which captures an image of the surface of a package. 

1 5 The high resolution camera 16 is responsive to a gray-scale light pattern such as 
that reflected by black ink text on the surface of the package 20c. The high 
resolution camera 16 is relatively unresponsive to light such as that reflected by 
fluorescent ink when illuminated by white light. More specifically, the 
commercially available National Ink No. 35-48-J (Fluorescent Yellow) is 

20 substantially invisible to the high resolution camera 16 when illuminated by the 
white light source 28. 

Suitable high resolution camera systems are described in U.S. 
Patent Nos. 5J27J71 to SmUh et aL. entitled "Camera System Optics" (*'the 
'171 patent''), and 5,308,960 to Smith et al., entitled "Combined Camera 

25 System/' and in allowed U.S. Application No. 08/292,400, filed August 18, 
1994, entitled "Optical Path Equalizer' ("the Optical Path Equalizer 
application"), all of which are assigned to the assignee of the present invention 
and incorporated herein by reference. 

The '171 patent describes an 0TB camera system for capturing 

30 images of packages as they move beneath the camera on a conveyor belt. The 
system described in the '171 patent includes an illumination source, a belt 
encoder for determining the speed and position of the conveyor belt, and a 
processing subsystem that searches for a number of different acquisition targets. 

The Optical Path Equalizer application describes an OTB camera 

35 with an optical system that equalizes the path between the OTB camera and the 
package located beneath the camera. This allows the camera to accurately focus 
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on the package surface regardless of the package's height, and also maintains an 
approximately constant image size regardless of the height of the package. The 
optics assembly includes a pair of movable mirrors and an array of fixed 
mirrors. The movable mirror are mounted on pivot pins and are rotated by one 
5 or more actuators. The array of fixed mirrors includes a plurality of mirrors 
positioned at increasing distances from the movable mirrors as to provide a 
plurality of different optical path lengths between the camera and the package 
surface. The Optical Path Equalizer application also describes the use of a 
height sensing device such as a commercially available light curtain. The data 

10 from the height sensing device is used to determine the optical path length of the 
variable optical subsystem. 

The label decoding system 14 processes the data provided by the 
imaging system 12. The label decoding system 14 includes input/output 
devices for receiving data from the fiduciary mark detector 24 and the high 

15 resolution camera 16, The label decoding system includes both general purpose 
computers and high performance computers. The high pertbrmance computers, 
such as Adaptive Solutions CNAPS processor and Imaging Technologies 
150/40 processor, are used to run that OCR algorithms that are used to decode 
the alphanumeric destination address data. The general purpose computers, 

20 such as Heurikon Nitro 60 and Heurikon HKV4D computers, are used to 
process the location and orientation data from the fiduciary mark detector 24 
and to decode detect and decode the bar code that includes the package tracking 
information. The label decoding system includes storage devices such as 
memory, disk drives and tape drives. The label decoding system may also be 

25 connected to other computing equipment that is used for package tracking, 
billing, etc. 

The label decoding system 14 is connected to a image server 29, 
which is connected to a network that includes a plurality of image display 
workstations 30a-c. If the label decoding system is unable to verify a decoded 

30 destination address by reference to the U.S. Postal Service's ZIP+4 database, 
the system 10 displays the destination address image on one of the image 
display workstations 30a-c, where it is viewed by an operator. The displayed 
destination address image is accompanied by the closest addresses from the 
database. The operator than reads the address on the display and manually 

35 enters the correct address or selects the correct address from the list of the 
closest addresses. Thus, the image display workstation must include a display, 
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a processor, input means such as a keyboard, and input/output means for 
conmiunication data to and from the label decoding system. The preferred 
image display workstations 30a-c are IBM compatible personal computers 
based on Intel Corporation's PENTIUM processor and running Microsoft 
5 Corporation's WINDOWS NT operating system. Those skilled m the art will 
appreciate that the image display workstations may include any computer 
imaging system or other computer image processor capable of receiving and 
processing pixel images and other information at high rates of speed, and that 
the number of such image display workstations used in a facility will depend on 
10 the volume of packages moving through the system and various other factors. 
Those skilled in the art will also appreciate that the image server 29 may be any 
computer or network server capable of being connected to the image display 
workstations and capable of transferring and processing pixel images at high 
rates of speed. 

15 The label decoding system is also connected to at least one label 

printer 32. As mentioned briefly above, the decoded package identification 
information and destination address are combined to form a unified package 
record, which may be used to facilitate the track and sorting of the package 
throughout the delivery system. While the unified package record may be 

20 stored in a database, it may also be printed on a label and automatically affixed 
to the package as it travels on the conveyor belt. The preferred label printer 32 
is an automatic label applicator, manufactured by Accusort. In the preferred 
system 10, the unified package record is printed in machine readable dense 
code, such as the codes described in U.S. Patent Nos. 4,896,029 to Chandler e! 

25 al., entitled 'Tolygonal Information Encoding Article, Process and System" and 
4,874,936 to Chandler et aL, entitled "Hexagonal, Information Encoding 
Article, Process and System." Those skilled in the art will appreciate that the 
number of label printers will depend on the configuration of the conveyor 
system, the number of packages moving through the system, and other factors. 

30 

The Preferred Method for 
Reading Package Information 

The preferred method for reading package information will now 
be discussed in conjunction with Figs. 3-5. As described above, the system 10 
35 is operative for capturing an image of a package as it travels on a conveyor belt, 
and detecting and decoding a bar code and OCR address data that appear on the 
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package. The OCR data is validated and, if not accurate, is displayed on a 
terminal where an operator can manually enter the address data. The decoded 
bar code data and address data are combined to form a unified package record, 
which is subsequently used to sort and track the package. 
5 Fig. 3 is a flow diagram illustrating the preferred method 300 

for reading package information. The steps that form the method 300 are 
carried out by the various equipment that forms a part of the system 10 for 
reading package information. The method 300 begins at step 302 by 
determining the location and orientation of the destination address block. In the 

10 preferred system, this is accomplished as the package moves beneath the 
fiduciary mark detector 24, which is described above in conjunction with Figs. 
I and 2. The coordinate and orientation information from the fiduciary mark 
detector are provided to the label decoding system 14. where they are used to 
process the image that is provided by the high resolution camera 16. 

15 After the package is scanned by the fiduciary mark detector, the 

package height is determined by the package height sensor 26 at step 304. At 
step 306 a high resolution image of the top of the package is captured by the 
high resolution OTB camera 16 as the package passes beneath the high 
resolution camera. This image is provided to the label decoding system 14. 

20 The high resolution camera 16 uses the package height data from the package 
height sensor 26 to adjust the focal length of the camera and ensure that the 
camera is properly focused regardless of the height of the package. 

At step 308 the label decoding system 14 processes the data 
from the belt encoder 44, the fiduciary mark detector 24. and the high 

25 resolution camera 16. Generally described, the processmg performed by the 
label decoding system includes locating and decoding the bar code, locating and 
decoding the destination address, verifying the accuracy of the destination 
address, and receiving a manually entered destination address if needed. The 
particular steps involved in processing the data are described below in 

30 conjunction with Fig. 4. 

At step 310 the bar code and destination address data are 
combined to form a unified package record, which is stored in a database or 
printed on a label and affixed to the package at step 312. The data contained in 
the unified package record is subsequently used for sorting and tracking the 

35 package as it moves through the deliver^' company's system. The method 300 
terminates at step 314. 
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Fig. 4 is a flow diagram illustrating the preferred method 308 
for processing image data. This method is carried out by the label decoding 
system 14 and forms a part of the method 300 of Fig. 3. The method 308 
begins at step 400 when the label decoding system receives the data from the 
5 belt encoder 44, the fiduciary mark detector 24 and the high resolution OTB 
camera 16. As described above, the high resolution camera provides an image 
of the top of a package. The image includes a bar code 36 and a destination 
address 38. The fiduciary mark detector provides data indicating the location 
and orientation of the destination address block 40. 

10 At step 402 the label decoding system 14 locates and decodes 

the bar code 36 or other machine readable symbol, which is contained in the 
image provided by the high resolution camera 16. Those skilled in the art will 
be familiar with various systems and methods for locating and decoding bar 
codes. Suitable methods for locating and decoding the bar code 36 are 

15 described in U.S. Patent Nos. 5,343,028 to Figarella et a/., entitled "Method 
and Apparatus for Detecting and Decoding Bar Code Symbols Using Two- 
Dimensional Digital Pixel Images," 5352,878 to Smith et aL. entitled "Method 
and Apparatus for Decoding Bar Code Symbols Using Independent Bar and 
Space Analysis," 5,412,196 to Surka, entitled "Method and Apparatus for 

20 Decoding Bar Code Images Using Multi-Order Feature Vectors/' and 
5,412,197 to Smith, entitled "Method and Apparatus for Decoding Bar Code 
Symbols Using Gradient Signals," all of which are assigned to the assignee of 
the present invention and incorporated herein by reference. Those skilled in the 
art will appreciate that the machine readable code or symbol decoded by the label 

25 decoding system may include a bar code or a two-dimensional code. 

At step 404 the method 308 begins the process of locating and 
decoding the destination address. Steps 404 through 422 are associated with 
the application of optical character recognition (OCR) techniques to the image 
provided by the high resolution camera 16. This process is carried out in 

30 parallel with decoding the bar code (step 402). 

At step 404 the label decoding system selects a subimage of the 
package surface from the image provide by the high resolution camera 16. In 
the preferred system, this subimage is referred to as a region of interest (ROI), 
which is defined with respect to the fiduciary mark 42. In terms of the image 

35 from the high resolution camera, the region of interest is a Ik by Ik square (i.e., 
1,024 pixels by 1,024 pixels, which is equivalent to approximately four inches 
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by four inches) centered on the defined position of the fiduciarv' mark 42. The 
label decoding system 14 determines the position and orientation of the 
fiduciary mark 42 and uses that information to define the region of interest with 
respect to the position of the fiduciary mark 42. The label decoding system 
5 then creates and stores a high resolution text image within the region of interest 
from the data captured by the high resolution camera 16, In this manner, only a 
relatively small portion of the data captured by the high resolution camera 16 is 
processed in order to decode the destination address data. This image is 
referred to as the region of interest (ROD image. 

10 Although the system 10 locates the destination address block 

using the information provided by the fiduciary mark detector 24. those skilled 
in the art will appreciate that software techniques may be implemented to detect 
the location and orientation of the destination address from the image provided 
by the high resolution OTB camera. Suitable techniques would eliminate the 

15 need for the fiduciary mark detector, but would require additional computing 
resources in the label decoding system 14. Such software techniques may be 
used without departing from the spirit and scope of the present invention. 
Furthermore, those skilled in the art will appreciate that the fiduciary mark 
detector described above may be replace with other apparatus for indicating and 

20 detecting the location and orientation of an indicia on a package, such as the 
systems described in U.S. Patent Nos. 4,516.265 to KizL4 et ciL and 5.103.489 
to Miette. 

At step 406 the method performs adaptive thresholding on the 
ROI image. This technique involves binarizing the ROI image and creating 
25 three different binarized images using three different threshold values. The 
three threshold values are determined by measuring the contrast and relative 
brightness of the ROI image. 

At step 408 the three images resulting from step 406 are run 
length encoded. At step 410 the best of the three run length encoded images is 
30 selected for further processing. 

Suitable methods for carrying out steps 406. 408, 410 are 
described in commonly owned U.S. Application No. 08/380,732, filed January 
31, 1995, entitled '^Method and Apparatus for Separating Foreground From 
Background in Images Containing Text," which is incorporated herein by 
35 reference. 
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At step 412 the label decoding system performs a coarse rotation 
of the selected run length encoded image. The coarse rotation is the first of a 
two-step process that is designed to make the ROI image appear horizontal in 
order to simplify the separation of the characters. Generally described, the 
5 information derived from the fiduciary mark indicates the orientation of the 
destination address block and how far off of horizontal it is. The coarse rotation 
is the first step toward rotating the image to where the destination address 
appears horizontal. 

The preferred method for rotatmg the ROI image is described in 

10 commonly owned U.S. Application No. 08/507,793, filed July 25, 1995, 
entitled "Method and System for Fast Rotation of Run-Length Encoded 
Images/' which is incorporated herein by reference. Those skilled in the art will 
appreciate that the coarse rotation process is relatively quick and rotates the 
image to within ± 7 degrees of horizontal. 

15 At step 414 the label decoding system identifies the lines of text 

that are contained in the destination address block 40. This is accomplished by 
subsampling the image by a factor of 3 in the x and y directions, executing a 
connected components process that finds groups of linked pixels, and applying 
a Hough transform that finds line locations and orientations from the linked 

20 pixels. 

Once the lines are found using the reduced resolution method, 
the original lines are restored to full resolution using the location information 
generated by the Hough transform. Another connected components analysis is 
applied to the full resolution lines in order to capture the text characters. Those 

25 skilled in the art will understand that connected components analysis and Hough 
transforms are standard image processing techniques. 

Once the lines are identified, the method 308 proceeds to step 
416 and performs a fine rotation on the characters included in each line of the 
destination address. This fine rotation completes the rotation process begun at 

30 step 412 and rotates the characters to horizontal (i.e., zero degrees). This 
ensures that the characters are properly oriented for the application of the OCR 
algorithm, which attempts to decode each character in the destination address. 
This step is accomplished by applying forward rotational techniques. The 
preferred rotational techniques are described by the following formulas: 

35 

>^new = (Xold * cos 0) + {y^\^ ^- sin 0) 
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ynew = (^old * sin 0) - (yold * cos 0) 

where 0 is the orientation of the destination address after the coarse rotation 
performed at step 412. 
5 At step 418 the rotated characters are segmented or separated 

into separate characters. This is done because the OCR algorithm is applied to 
each character individually. At step 420 the OCR algorithm is applied to each 
of the characters in the destination address. Those skilled in the an will 
appreciate that the OCR algorithm uses a variety of techniques to recognize each 

10 characters and to determine what standard ASCII characters is represented by 
each character in the destination address. Those skilled in the art will also 
appreciate that the OCR algorithm may be used to decode other alphanumeric 
information on the package, such as the return address, shipper number, etc. A 
suitable OCR technique is described in U.S. Patent No. 5,438,629, entitled 

15 "Method and Apparatus for Classification Using Non-spherical Neurons/' 
which is incorporated herein by reference. 

At step 422 the OCR processed text is filtered to. remove any 
characters that are not a part of the destination address. 

At step 424 the OCR processed destination address is validated 

20 or verified by attempting to match the decoded destination address with an 
address in the U.S. Postal Service's ZIP+4 database, which provides an 
exhaustive list of valid addresses in the United States. This step is necessary 
because the destination address and OCR algorithms do not include built in 
verification means such as checksums, etc. 

25 At step 426 the method 308 determines whether the decoded 

destination address matched a valid address in the ZIP+4 database or other 
database of valid addresses. If so, the method continues to step 428 where it 
returns to step 310 of the method 300 (Fig. 3). Related methods lor 
processing data in databases are described in commonly owned U.S. 

30 Application Serial No. 08/477,481, filed June 7, 1995 and entitled '^A Multi- 
Step Large Lexicon Reduction Method for OCR Application." which is 
incorporated herein by reference. 

If the decoded address does not match a valid address in the 
ZIP+4 database, the method 308 proceeds to step 430 and automatically 

35 attempts to correct common OCR errors in order to automatically provide a valid 
address. Typical OCR errors involve incorrectly decoding letters that look 
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similar. Therefore, step 430 is optimized to correct OCR errors by substituting 
such letters in an attempt to match one of the valid addresses that appears in the 
address database. 

Those skilled in the art will understand that the validation 
5 process is tunable and involves three parameters. The accuracy rate indicates 
the percentage of labels that are automatically read correctly. The error rate 
indicates the percentage of labels that the system thinks it is has correctly, but 
are in fact incorrect. The rejection rate indicates the percentage of labels that are 
not read correctly and which must be entered manually. The OCR validation 

10 process is tuned by first determining an acceptable error rate. Once this is 
determined, the system is tuned by adjusting the parameter that controls the 
relationship between the rejection rate and the error rate. 

At step 432 the method determines whether the substituted 
characters have resulted in a valid address. If so. the method proceeds to step 

15 428. 

If the method is unable to match correct the decoded address and 
match a valid address in the ZIP+4 database, the method proceeds to step 434 
and transfers the image to a the image server 29. which is connected to one or 
more image display workstations. The image display workstations display an 

20 image of the destination address block and the closest possible addresses from 
the database. The image display workstation allows an operator to view the 
image of the destination address and manually enter the destination address into 
the workstation. This process (step 436) is described more completely in 
conjunction with Fig. 5. 

25 At step 438 the method 308 receives the manually entered 

destination address data from the image server. The information returned by the 
image server may take the form of manually entered address data or a selected 
one of the possible addresses from the database. After the address data is 
received from the image server, the method 308 proceeds to step 428 and 

30 returns to the method 300. 

Fig. 5 is a flow diagram illustrating a method 500 carried out by 
the image server 29 and the image display workstations 30a-c that form a part 
of the preferred system 10. As described above, the image display 
workstations are used to allow an operator to manually enter destination 

35 addresses that were not properly matched to valid addresses in the ZIP+4 
database. This is accomplished by displaying an image of the destination 
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address and the closest possible addresses from the database. The operator 
reads the address as it appears on the display and manually enters the address 
into the workstation or selects one of the displayed addresses. This manually 
entered address data is then returned to the label decoding system 14 where it 
5 replaces the improperly decoded OCR data. 

The method SOO begins at step 502 where the image server 
receives the image of the destination address from the label decoding system 
14. The image server routes the image to a free image display workstation. At 
step 504 the image display workstation rotates the image to the nearest 

10 horizontal or vertical axis. At step 506 the rotated image is interpolated to form 
an image having a resolution of ai least 100 dots per inch (DPI) image, which is 
displayed at step 508. In addition to the destination address image, the 
workstation also displays the closest possible matches from the ZIP+4 database. 

At step 510 the operator manually enters the destination address 

15 after having read the destination address presented on the display. The operator 
manually enters the correct destination address by selecting the correct address 
from the closest possible matches (if the correct address is displayed) or 
entering the address using a keyboard associated with the image display 
workstation. 

20 At step 512 the method determines whether the destination 

address data entered by the operator was selected from the list of possible 
addresses selected from the database. If so, the method proceeds to step 514 
and returns the correct destination address to the image server 29, which returns 
the data to the label decoding system 14. The method 500 then terminates at 

25 .step 518, 

If at step 512 the method determines that the destination address 
data was typed in by the operator, the method goes to step 516 to validate the 
typed-in data. Those skilled in the art will appreciate that the error correction 
routine may be carried out at the image display workstation where the data was 

30 entered, at the image server after the data was returned from the image display 
workstation, or at a separate validation computer connected to the image server 
via the network. 

Those skilled in the art will appreciate that the validation process 
of step 516 determines whether the keyed in address matches a valid address 

35 from the database. If not, the method also attempts to correct common key 
entry mistakes in order to see if the corrected key entered data matches one of 
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the addresses from the database. The validation/correction process is similar to 
the correction process described in conjunction with step 430 of Fig. 4, but is 
optimized for common key entry errors, which include substituting keys that are 
close together on the keyboard or letters that are transposed by the operator. 
5 The correction can be carried out by attempting to match a valid address from 
any address in the ZIP+4 database, or by tr>Mng to match one of the few close 
addresses transferred to the image display workstation from the label decoding 
system. 

After the manually entered destination address data is validated, 

10 the method proceeds to step 514 and returns the correct destination address to 
the image server 29, which returns the data to the label decoding system 14. 
The method 500 then terminates ai step 518. 

From the foregoing description, it will be appreciated that the 
present invention provides an efficient system and method for reading package 

15 information. The present invention has been described in relation to particular 
embodiments which are intended in all respects to be illustrative rather than 
restrictive. Those skilled in the art will appreciate that many different 
combinations of hardware will be suitable for practicing the present invention. 
Many commercially available substitutes, each having somewhat different cost 

20 and performance characteristics, exist for each of the components described 
above- 
Similarly, the method of the present invention may conveniently 
be implemented in program modules that are based upon the flow charts in Figs. 
3-5. No particular programming language has been indicated for carrying out 

25 the various procedures described above because it is considered that the 
operations, steps and procedures described above and illustrated in the 
accompanying drawings are sufficiently disclosed to permit one of ordinary skill 
in the art to practice the instant invention. Moreover, there are many computers 
and operating systems which may be used in practicing the instant invention and 

30 therefore no detailed computer program could be provided which would be 
applicable to these many different systems. Each user of a particular computer 
will be aware of the language and tools which are most useful for that user's 
needs and purposes. 

Alternative embodiments will become apparent to those skilled in 

35 the art to which the present invention pertams without departing from its spirit 
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and scope. Accordingly, the scope of the present invention is defined by the 
appended claims rather than the foregoing description. 
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Claims 

What is claimed is: 

5 1 . A method for reading package information from a 

package (20), said package information including first information indicia (36) 
and second information indicia (38), comprising the steps of: 

capturing an image of said package (20), said image 
including said first information indicia (36) and said second information indicia 
10 (38); 

locating said first information indicia (36) in said image: 
decoding said first information indicia (36) to provide 

first package data; 

locating said second information indicia (38); 
15 decoding said second information indicia (38) to provide 

second package data; and 

combining said first package data and said second 
package data to form a unified package record. 

20 2. A method for reading package information according to 

claim 1 , further comprising the steps of: 

determining whether said second package data is valid; 
displaying said image on a workstation (30); and 
receiving manually entered second package data, and 
25 wherein said unified package record comprises said first package data and said 
manually entered second package data. 

3. A method for reading package information according to 
claim 2, wherein said manually entered second package data comprises a 

30 destination address selected from a list of possible destination addresses 
displayed on said workstation (30). 

4. A method for reading package information according to 
claim I or claim 2, wherein said first information indicia (36) comprises a 

35 machine readable symbol and said first package data comprises a package 
identification number. 
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5. A method for reading package information according to 
claim 1 or claim 2, wherein said first information indicia (36) comprises a bar 
code and said first package data comprises a package identification number. 

5 

6. A method for reading package information according to 
claim I or claim 2, wherein said second information indicia (38) comprises 
alphanumeric characters and said second package data comprises package 
destination information. 

10 

7. A method for reading package information according to 
claim 1 or claim 2. further comprising the step of storing said unified package 
record in a database. 

15 8. A method for reading package information according to 

claim 1 or claim 2, further comprising the steps of: 

printing a label containing said unified package record; 

and 

affixing said label to said package (20). 

20 

9. A method for reading package information according to 
claim 1 or claim 2> wherein locating said second information indicia (38) 
comprises the steps of: 

identifying a mark (42) indicative of the location of said 
25 second information indicia (38); and 

using said mark (42) to locate said second information 

indicia (38). 

10. A method for reading package information according to 
30 claim 9, further comprising the step of rotating said second information indicia 

(38). 
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11. A system for reading package information from a 
package (20), said package information including first information indicia (36) 
and second information indicia (38), comprising: 

an imaging system including a camera (16) for capturing 
5 an image of said package (20); 

a label decoding system (14) for processing said image; 

and 

a printer for printing a label to be affixed to said package 

(20); 

10 said label decoding system (14) being programmed to: 

locate said first information indicia (36) in said 

image; 

decode said first information indicia (36) to 

provide first package data; 
1 5 locate said second information indicia (38); 

decode said second information indicia (38) to 
provide second package data; and 

combine said first package data and said second 
package data to form a unified package record for printing on said label. 

20 

12. A system for reading package information according to 
claim 1 K further comprising an image display workstation (30) for displaying at 
least a portion of said image and for receiving manually entered data 
corresponding to said second information indicia (38), and wherein said label 

25 decoding system ( 14) is further programmed to: 

determine whether said second package data is valid; 
display said image on said workstation (30); and 
receive manually entered second package data, and 
wherein said unified package record comprises said first package data and said 

30 manually entered second package data. 

13. A system for reading package information according to 
claim 11 or claim 12, wherein said first information indicia (36) comprises a 
machine readable symbol and said first package data comprises a package 

35 identification number. 
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14. A system for reading package information according to 
claim 1 1 or claim 12, wherein said first information indicia (36) comprises a bar 
code and said first package data comprises a package identification number. 

5 15. A system for reading package information according to 

claim 1 1 or claim 12, wherein said second information indicia (38) comprises 
alphanumeric characters and said second package data comprises package 
destination information. 

10 16. A system for reading package information according to 

claim 11 or claim 12» wherein said label decoding system (14) is further 
programmed to store said unified package record in a database. 

17. A system for reading package information according to 
15 claim 11 or claim 12, wherein locating said second information indicia (38) 
comprises: 

identifying a mark (42) indicative of the location of said 
second information indicia (38); and 

using said mark (42) to locate said second information 

20 indicia (38). 
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(18) versehen, auf dem fiir das menschliche Auge erkennbare und fiir einen menschlichen Betrachter unierscheidungskraftige Information 
gespeichert ist. Dabei ist das technische Gerat (10) mit einer Lese- und Auswertevorrichtung (20) fiir diese Information versehen. Die 
Lcse- und Auswertevorrichtung (20) weist eine Vergleichseinrichtung (43) zum Vcrgleich der gelesenen Information mit einer gespeicherten 
Infomiation sowie eine Freigabesteuerung (46) fur zumindest eine Funktionskomponente (48) des technischen Gerats auf. Bei einer 
Cbereinstimmung der gelesenen Infomtation mit der gespeicherten Information wird ein Authentifizierungssignal oder Freigabesignal von 
der Freigabesteuerung (46) an die Funktionskomponente (48) geiiefert, die daraufhin den Betrieb des technischen Gerats (10) ermdglicht 
und die bei fehlender Cbereinstimmung der gelesenen Information mit der gespeicherten Information den Betrieb des technischen GerSts 
(10) spent und ein Wamsignal ausgibt. 
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[ I wird der vom Anmelder eingereichte Wortlaut genehmigt. 
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[aj Anmelder kann der Behorde innerhalb eines Monats nach dem Datum der Absendung dieses internationalen 
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[X] wle vom Anmelder vorgeschlagen Q keine der Abb. 

I I well der Anmelder selbst kelne Abbildung vorgeschlagen hat. 
I I well diese Abbildung die Erfindung besser kennzeichnet. 
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System und Verfahren zur Ident if izierung und 
Authentif izierung von Zubehor, Hilfs- und/oder 
Betriebsstof f en fur technische Gerate 

Die Erfindung betrifft ein System zur Ident if izierung und 
Authentif izierung von Zubehor, Hilfs- und/oder 

Betriebsstof fen fur technische Gerate. Sie betifft weiterhin 
ein Verfahren zur Erkennung und Decodierung von auf einem 
optisch lesbaren Datent ragerabschnitt gespeicherter 
Information . 

Es kommt haufig vor, dafi Zubehorteile oder Hilfsstoffe 
beziehungsweise Betriebsstof fe fur technische Gerate aufter 
vom Hersteller des technischen Gerates auch von 
Drittanbietern hergestellt und vertrieben werden. Haufig 
entsprechen derartige Produkte von Drittanbietern nicht den 
hohen Qualitats- und Sicherheit sanf orderungen des Herstellers 
des technischen Gerats, lassen sich jedoch ohne grofiere 
technische Probleme in Verbindung mit dem technischen Gerat 
einsetzen. Fur den Hersteller eines technischen Gerats ist es 
im allgemeinen schwierig, die Zuverlassigkeit und Sicherheit 
des technischen Gerats zu gewahrleisten, wenn derartige 
Zubehorprodukte oder Hilfs- beziehungsweise Betriebsstof fe 
von Drittanbietern eingesetzt werden, da die Entscheidung 
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uber den Einsatz derartiger Drittanbieter-Produkte im 
allgemeinen beim Benutzer des technischen Gerats liegt. 


Es ist daher nicht nur im Interesse des Gerateherstellers 
sondern auch im Interesse der Benutzer derartiger technischer 
Gerate, wenn zuverlassig gewahrleistet wird, daft technische 
Gerate ausschlieftlich mit vom Geratehersteller autorisiertem 
Zubehor und mit vom Geratehersteller autorisierten Hilfs- 
beziehungsweise Betriebsstof f en eingesetzt werden konnen. 


Es ist daher die Aufgabe der vorliegenden Erfindung, eine 
Kennzeichnung fur Zubehor und Hilfs- beziehungsweise 
Bet riebsstof f e oder deren Auf bewahrungsgef aBe sowie ein 
Identif ikationssystem zu schaffen, die eine eindeutige 
Identif izierung einer Autorisierung durch den Hersteller 
eines technischen Gerats zulassen und die es gestatten, die 
Verbreitung von nichtautorisiertem Zubehor beziehungweise von 
nichtautorisierten Hilfs- oder Bet riebsstof fen zu 
unterbinden . 


Diese Aufgabe wird durch das im Anspruch 1 angegebene System 
gelost . 

Das Vorsehen der fur das menschliche Auge erkennbaren und fur 
einen menschlichen Betrachter unterscheidungskraf tigen 
Information auf dem Zubehor beziehungsweise den Hilfs- oder 
Betriebsstof fen oder deren Auf bewahrungsgef alien und der Lese- 
und Auswertevorrichtung fur diese Information am technischen 
Gerat ermoglicht es, daft das technische Gerat vorzugsweise 
ebenfalls visuell uberpriifen kann, ob die auf dem 
Datentragerabschnitt vorgesehene Information mit einer im 
technischen Gerat gespeicherten vorgegebenen Information 
ubereinstimmt , sodaft nur bei Ubereinst immung ein Betrieb 
eines technischen Getrats ermoglicht wird. Diese 
Authentif izierungsf unktion des erf indungsgemaften Systems wird 
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erganzt durch die Er kennbar keit der Information fur das 
menschliche Auge und durch deren fur einen menschlichen 
Betrachter im allgemeinen unmittelbar , das heiBt ohne 
langeres Betrachten, unterscheidungskraf tige Eigenschaf t . 
Somit kann der Benutzer zunachst mit den eigenen Augen 
uberprlifen, ob es sich bei dem Zubehor beziehungsweise bei 
den Hilfs- oder Betriebsstof f en um vom Hersteller 
autorisierte Produkte handelt . 

Insbesondere vorteilhaft ist es, wenn die fur das menschliche 
Auge erkennbare und fur den menschlichen Betrachter 
unterscheidungskraf tige Information von einem Mar kenzeichen 
gebildet ist. Wird die Benutzung des technischen Gerats mit 
dem Zubehor beziehungsweise den Hilfs- oder Betriebsstof fen 
in diesem Fall nur dann freigegeben, wenn auf dem 
Datentragerabschnitt das fur das menschliche Auge erkennbare 
Markenzeichen, in der Regel eine registrierte und geschutzte 
Marke des Herstellers, vorgesehen ist, so kann der Hersteller 
den Vertrieb von nichtautorisiertem Zubehor beziehungsweise 
nichtautorisierten Hilfs- oder Betriebsstof fen fur das 
technische Gerat unmittelbar aufgrund einer Mar kenver let zung 
unterbinden, da ein nichtautor isierter Dritthersteller , um 
die Funkt ionsf ahigkeit zu gewahrleisten, das anderweitig 
geschutzte Mar kenzeichen in unerlaubter Weise benutzen muB . 
Anstelle eines Mar kenzeichens kann auch ein anderweitig 
geschutztes graphisches oder schrif tbildliches Element 
vorgesehen sein. 

Weist der Datentragerabschnitt einen ersten Bereich auf, in 
dem nur maschinenlesbare Information gespeichert ist und 
einen zweiten Bereich, in dem die fur das menschliche Auge 
erkennbare und fur den menschlichen Betrachter 
unterscheidungskraf tige Information gespeichert ist, so 
lassen sich zusatzlich zu der fur das menschliche Auge 
erkennbaren Information noch Daten auf dem 
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Datentragerabschnitt unterbringen, die ebenfalls von der 
Lese- und Auswertevor richtung des technischen Gerats gelesen 
und ausgewertet werden konnen, wobei diese Daten 
beispielsweise technische Daten des Produkts, also des 
entsprechenden Zubehors oder des ent sprechenden Hilfs- oder 
Betriebsstof f es, aufweisen. In diesem Fall kann der erste 
Bereich eine variable, produktabhangige Information 
enthalten, wahrend der zweite Bereich eine statische, fur 
alle Produkte gleiche, herstellerabhangige Information 
umf alit . 


Vorzugsweise ist auf dem Datentragerabschnitt zumindest eine 
Ref erenzmar kierung fiir die Orientierung der Lesevorr ichtung 
vorgesehen. Hierdurch wird eine sichere Erkennung der Daten 
auf dem Datentragerabschnitt gewahr leistet , auch wenn der 
Datentragerabschnitt in unter schiedlichen Lagen an der 
Lesevorr ichtung vorbeigef uhrt wird . 


Welter vorzugsweise ist die auf dem ersten Bereich des 
Datent ragerabschnitt s gespeicherte Information von einem 
maschinenlesbaren Code gebildet und die auf dem zweiten 
Bereich des Datentragerabschnitt s gespeicherte Information 
ist von einem Mar kenzeichen gebildet. 


In einer weiteren bevorzugten Ausf uhrungsf orm weist der erste 
Bereich des Datentragerabschnitt s eine Vielzahl von Zeilen 
eines binaren Pixelcodes auf, wobei der binare Pixelcode eine 
Mehrzahl von Zeilen der nur maschinenlesbaren Information 
enthalt, und der zweite Bereich des Datentragerabschnitt s 
weist eine Mehrzahl von Zeilen eines Pixelcodes auf, die 
gemeinsam die fiir das menschliche Auge erkennbare und fur den 
menschlichen Betrachter unterscheidungskraf tige Information 
bilden . 


wo 99/42921 


5 


PCT/EP99/01091 


Durch den zeilenweisen binaren Pixelcode im ersten Bereich 
wird eine Codierungsmoglichkeit geschaffen, die eine sehr 
hohe Datendichte pro Flacheneinheit des Datentragerabschnitts 
gestattet. 

5 

Die Darstellung der fur das menschliche Auge erkennbaren und 
fur den menschlichen Betrachter unterscheidungskraf t igen 
Information als zeilenweiser Pixelcode erleichtert die 
Auswertung der Information des Datentragerabschnitts, die auf 
10 diese Weise mit ein und derselben Lese- und 

, Auswertevorrichtung fur den ersten Bereich und den zweiten 
Bereich erfolgen kann . 

Bevorzugt ist zwischen dem ersten Bereich des 
15 Datentragerabschnitts und dem zweiten Bereich des 

Datentragerabschnitts eine maschinenlesbare Grenzmar kierung 
vorgesehen, die vorzugsweise aus zumindest einer Leerzeile 
besteht. Hierdurch wird sowohl fur das menschliche Auge als 
auch fur die Lesevorr ichtung eine klare Abgrenzung des ersten 
20 und zweiten Bereichs geschaffen. 

AuBerdem wird bevorzugt, wenn die Referenzmar kierung einen 
zumindest einen der beiden Bereiche des Datentragerabschnitts 
umgreifenden Rahmen aufweist. 

25 

Zur Er leichterung des Auslesens weist der binare Pixelcode 
einer Zeile jeweils eine Reihe von nebeneinanderliegenden 
Bit-Mar kierungen der binaren Darstellung einer Information 
auf . 

30 

Vorzugsweise sind zur Erhohung der Auslesesicherheit in jeder 
J Zeile zusatzlich binare Bit-Mar kierungen fur eine Prufziffer 

fur die binare Darstellung der Information vorgesehen. 


35 
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Ein Verfahren zur Erkennung und Decodierung von auf einem 
optisch lesbaren Datentragerabschnitt eines Systems gemafi 
einem der Anspruche 1 bis 10 vorgesehener Information, wobei 
die Information fur das menschliche Auge erkennbar und fur 
5 einen menschlichen Betrachter unterscheidungskraf tig ist, 
umfaftt die Schritte: Erfassen der auf dem 
Datentragerabschnitt vorhandenen optischen Information, 
Auslesen der auf den Datentragerabschnitt vorhandenen 
optischen Information, Vergleichen der ausgelesenen 
10 Information mit einem gespeicherten Inf ormat ionsmuster und 
Erzeugung eines Authentif izierungssignals , wenn die 
ausgelesene Information des zweiten Bereichs als mit dem 
gespeicherten Inf ormat ionsmuster ubereinstimmend erkannt 
worden ist. 

15 

Ein alternatives Verfahren zur Erkennung und Decodierung von 
auf einem optisch lesbaren Datentragerabschnitt eines Systems 
gemafi einem der Anspruche 1 bis 10 vorgesehener Information, 
wobei zumindest ein Teil der Information fur das menschliche 

20 Auge erkennbar und fur einen menschlichen Betrachter 

unterscheidungskraf tig ist, umfaBt die Schritte: Erfassen der 
auf dem Datentragerabschnitt vorhandenen optischen 
Information, vorzugsweise Identif izieren der 
Ref erenzmarkierung, Identif izieren des ersten und zweiten 

25 Bereichs des Datent ragerabschnitts , Auslesen und Decodieren 
der im ersten Bereich enthaltenen Binarinf ormat ion, Auslesen 
der im zweiten Bereich enthaltenen Information, Vergleichen 
der ausgelesenen Information des zweiten Bereichs mit einem 
gespeicherten Inf ormat ionsmuster und Erzeugen eines 

30 Authenif izierungssignals , wenn die ausgelesene Information ^ 
des zweiten Bereichs als mit dem gespeicherten 

Inf ormationsmuster ubereinstimmend erkannt worden ist. , 


35 
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Die Erfindung wird nachfolgend anhand eines Beispiels unter 
Bezugnahme auf die Zeichnungen naher erlautert; in dieser 
zeigt : 

Fig. 1 den schematisch Aufbau eines erf indungsgemafien 
Systems , 

Fig. 2 einen Datentragerabschnitt eines erf indungsgemalien 
Systems und 

Fig. 3 ein Blockschaltbild des erf indungsgemafien Systems. 

Fig. 1 ist eine schematische Darstellung eines technischen 
Gerats 10, das eine Aufnahme 12 fur ein Hilfsstoff 14 
enthaltendes Auf bewahrungsgef afi 15 aufweist. Beispielsweise 
handelt es sich bei dem technischen Gerat urn ein Analysegerat 
fur die automatische Analyse von chemischen oder biologischen 
Proben, wobei der Hilfsstoff von einem Reagenz gebildet ist, 
das zur Analyse einer bestimmten (nicht gezeigten) Probe im 
technischen Gerat 10 verwendet wird. 

Das Aufbewahrungsgef aft 16 ist in seinem oberen Bereich mit 
einem Datentragerabschnitt 18 versehen, der nachfolgend unter 
Bezugnahme auf Fig. 2 noch naher erlautert wird. Am 
technischen Gerat 10 ist eine Lese- und Auswertevorrichtung 
20 vorgesehen, die beispielsweise eine Videokamera oder eine 
Still-Videokamera aufweist, deren Objektiv 22 auf den 
Datentragerabschnitt 18 gerichtet ist. 

In Fig. 2 ist der Datentragerabschnitt 18 stark vergroBert 
wiedergegeben . Der Datentragerabschnitt 18 weist einen ersten 
Bereich 24 auf, in dem eine maschinenlesbare Information 
gespeichert ist. Weiterhin weist der Datentragerabschnitt 18 
einen zweiten Bereich 26 auf, in dem eine fur das menschliche 
Auge erkennbare und fur den menschlichen Betrachter 
unterscheidungskraf tige Information gespeichert ist. Im 
Beispiel der Fig. 2 ist das die Buchstabenf olge "SCIL". 
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Zwischen dem ersten und dem zweiten Bereich ist eine 
Leerzeile als Grenzmar kierung 28 vorgesehen, in der keine 
Binarinf ormation gespeichert ist. Der erste Bereich 24 und 
der zweite Bereich 26 sowie die Grenzmar kierung 28 sind 
gemeinsam von einem eine Referenzmar kierung 30 bildenden 
Rahmen umgeben. 

Der erste Bereich 24 umfaBt eine Vielzahl von Zeilen, 32, 
32 \ 32" eines binaren Pixelcodes, der pro Zeile eine 
Vielzahl von Spalten 34, 34*, 34" aufweist, wobei jede 
Kombination aus Zeile und Spalte einen Pixelort darstellt, 
der entweder durch ein weifies oder ein schwarzes Pixel eine 
binare optische Information enthalt. Am rechten Ende der 
Zeilen sind drei Spalten 36, 36', 36" vorgesehen, die jeweils 
in Verbindung mit einer Zeile einen binaren Code einer 
Priifziffer fur die jeweilige Zeile enthalten. 

Im vorliegenden Beispiel bezeichnet eine weiBe Bit-Mar kierung 
38 den Binarwert "0", wohingegen eine schwarze Bit-Mar kierung 
40 den Binarwert "1" bezeichnet. 

Im zweiten Bereich 26 sind die Buchstaben "SCIL" durch 
ent sprechende zeilenweise Binarmar kierungen gebildet, wobei 
die Gesamtheit der Zeilen im zweiten Bereich 26 die fiir das 
menschliche Auge erkennbare und flir einen menschlichen 
Betrachter unterscheidungskraf tige Buchstabenkombination 
"SCIL" bilden. Anstelle von Buchstaben kann im zweiten 
Bereich genausogut eine graphische Darstellung, 
beispielsweise eine Logo, abgebildet sein. 

Wird im Betrieb der Datentragerabschnitt 18 von der Kamera 
der Lese- und Auswertevorrichtung 20 erfafit, so wird zunachst 
anhand der Ref erenzmarkierung der die Information tragende 
Bereich des Datent ragerabschnitt s ident if iziert . Danach wird 
das von der Kamera erzeugte Bild zeilenweise analysiert, urn 
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f estzustellen, ob an einem entsprechenden Pixelort 
(Kombination aus Zeile und Spalte) eine helle oder dunkle 
Oder farbige Bit-Mar kierung vorhanden ist, wobei 
unterschiedliche farbige Bit-Markierungen zur Erhohung der 
Inf ormationsdichte vorgesehen sein konnen. Die zeilenweise 
Codierung im ersten Bereich 24 wird entsprechend einem 
vorgegebenen Codierungsalgorythmus decodiert und der zweite 
Bereich 25 wird aufgrund der Grenzmar kierung 28 

identif iziert . Die Abbildung des zweiten Bereichs 26 wird mit 
einer in einem Speicher des technischen Gerats 10 
gespeicherten Abbildung verglichen, woraufhin, wenn der 
Vergleich eine Identitat der gespeicherten Abbildung mit der 
erfaBten Abbildung des Datentragers 18 ergibt, ein 
Authentif izierungssignal im technischen Gerat 10 erzeugt 
wird, das im vorliegenden Beispiel den Hilfsstoff 14 fur die 
Durchfuhrung einer Analyse zulalSt und damit die Analyse 
ermoglicht. Wird aufgrund einer fehlenden Ubereinstimmung 
kein Authentif i zierungssignal erzeugt, so wird eine 
Fehlermeldung am technischen Gerat 10 ausgegeben und dessen 
Betrieb fur den Hilfsstoff 14 gesperrt. 

In Fig. 3 ist ein Blockschaltbild dargestellt, das den 
prinzipiellen Aufbau des erf indungsgemafiien Systems zur 
Identif izierung und Authentif izierung zeigt . Das vom Objektiv 
22 der Kamera 21 vom Datentragerabschnitt 18 aufgenommene 
optische Signal wird in der Kamera 21 auf herkommliche Weise 
in ein elektronisches Bildsignal verwandelt . Das 
elektronische Bildsignal wird in einer Ausleseeinrichtung 41 
zum Beispiel zeilenweise ausgelesen und in einer 
nachgeordneten Decodiereinrichtung 42 unter Verwendung eines 
vorgegebenen Decodier-Algorythmus ' decodiert. Die so 
erhaltene Information wird in eine Vergleichseinrichtung 43 
weitergeleitet , in der diese vom Datentragerabschnitt 18 
ausgelesene Information mit einer in einer 
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Speichereinrichtung 44 gespeicherten Information verglichen 
wird. 

Im Fall der Obereinstimmung der gelesenen Information mit der 
gespeicherten Information wird von der Vergleichseinrichtung 
43 ein Freigabesignal an eine Freigabesteuerung 46 gesandt, 
welche daraufhin eine Funktionskomponente 48 des technischen 
Gerats 10 freigibt, so daB das technische Gerat 10 
betriebsbereit ist . 

Fuhrt der Vergleich der gelesenen Information und der 
gespeicherten Information in der Vergleichseinrichtung 43 2u 
keiner Obereinstimmung der beiden Inf ormationen, so wird ein 
Blockierungssignal von der Vergleichseinrichtung 43 an die 
Freigabesteuerung 46 gesandt, die daraufhin die 
Funktionskomponente 48 des technischen Gerats sperrt, so dali 
das technische Gerat nicht betriebsbereit ist, und ein 
optisches und/oder akustisches Signal wird ausgelost, um das 
Bedienpersonal des technischen Gerats 10 auf die fehlende 
Betriebsbereit schaft des technischen Gerats hinzuweisen. 

Die Funktionskomponente 48 kann beispielsweise eine 
Stromversorgung oder eine Steuerungs- und/oder 
Regeleinrichtung fur das technische Gerat 10 oder fiir einen 
Teil des technischen Gerats 10 sein. 

Die Erfindung ist nicht auf das obige Ausf uhrungsbeispiel 
beschrankt, das lediglich der allgemeinen Erlauterung des 
Kerngedankens der Erfindung dient. Im Rahmen des 
Schutzumf angs kann die er f indungsgemalie Vorrichtung vielmehr 
auch andere als die oben beschriebenen Ausgestaltungsf ormen 
annehmen. Die Vorrichtung kann hierbei insbesondere Merkmale 
aufweisen, die eine Kombination aus den jeweiligen 
Einzelmerkmalen der Anspruche darstellen. 
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So konnte auch beispielsweise eine Spiegelref lexkamera Oder 

eine Vidoekamera mit einer erf indungsgemaften Lese- und 

Auswertevorrichtung ausgestattet sein und die 

Wechselob j ekt ive fur diese Kamera konnten mit einem 

erf indungsgemafien Datentragerabschnitt versehen sein, um an 

dieser Kamera nur den Einsatz von Or iginalob j ekt iven des 

Kameraherstellers zu ermoglichen. 

Bezugszeichen in den Anspruchen, der Beschreibung und den 
Zeichnungen dienen lediglich dem besseren Verstandnis der 
Erfindung und sollen den Schutzumfang nicht einschranken . 
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AnsprUche 

1. System zur Identif izierung und Aut hent if i zierung von 
Zubehor, Hilfsstoffen und/oder Betr iebsstof f en fur 
technische Gerate, 

wobei das Zubehor beziehungsweise die Hilfs- oder 
Betriebsstof f e oder deren Auf bewahrungsgef afie (16) 
mit einem Datentragerabschnitt (18) versehen sind, 
auf dem fur das menschliche Auge erkennbare und fur 
einen men sch lichen Betrachter unterschei dungs kraf t ige 
Information gespeichert ist, 

wobei das technische Gerat (10) mit einer Lese- und 
Auswertevorrichtung (20) fur diese Information 
versehen ist und . 

wobei die Lese- und Auswertevorrichtung (20) eine 
Vergleichseinrichtung (43) zum Vergleich der 
gelesenen Information mit einer gespeicherten 
Information sowie eine Freigabesteuerung (46)' fur 
zumindest eine Funktionskomponente (48) des 
technischen Gerats (10) dergestalt aufweist, daI3 bei 
einer Ubereinst immung der gelesenen Information mit 
der gespeicherten Information ein 

Authentif izierungssignal oder Freigabesignal von der 
Freigabesteuerung (4 6) an die Funktionskomponente 
(48) geliefert wird, die daraufhin den Betrieb des 
technischen Gerats (10) ermoglicht und die bei 
fehlender Ubereinst immung der gelesenen Information 
mit der gespeicherten Information den Betrieb des 
technischen Gerats sperrt. 
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2. System nach Anspruch 1, 

dadurch gekennzeichnet , 

daft die fur das menschliche Auge erkennbare und fur den 
menschlichen Betrachter unterscheidungskraf tige 
5 Information von einem Mar kenzeichen gebildet ist, 

3. System nach Anspruch 1 oder 2, 
dadurch gekennzeichnet , 

daJi der Datentragerabschnitt (18) einen ersten 
10 Bereich (24) aufweist, in dem nur maschinenlesbare 

Information gespeichert ist, und 

dafi der Datentragerabschnitt (18) einen zweiten 
Bereich (26) aufweist, in dem die fur das menschliche 
Auge erkennbare und fur den menschlichen Betrachter 
15 unterscheidungskraf tige Information gespeichert ist. 

4. System nach einem der vorhergehenden Anspruche, 
dadurch gekennzeichnet , 

daB auf dem Datentragerabschnitt (18) zumindest eine 
20 Ref erenzmarkierung (30) fur die Orientierung der 

Lesevorr ichtung (20) vorgesehen ist. 

5. System nach einem der vorhergehenden Anspruche^. 
dadurch gekennzeichnet , 

25 - dal3 die auf dem ersten Bereich (24) des 

Datentragerabschnitts ( 18 ) gespei chert e Information 
von einem maschinenlesbaren Code gebildet ist und 
daft die auf dem zweiten Bereich (26) des 
Datentragerabschnitts ( 18 ) gespeicherte Information 

30 von einem Mar kenzeichen gebildet ist. 

6. System nach einem der vorhergehenden Anspruche, 
dadurch gekennzeichnet , 

dafi) der erste Bereich (24) des Datentragerabschnitts 
35 (18) eine Vielzahl von Zeilen (32, 32', 32") eines 
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binaren Pixelcodes aufweist, wobei der binare 
Pixelcode die nur maschinenlesbare Information 
enthalt, und 

daE> der zweite Bereich (26) des Datentragerabschnitt s 
(18) eine Mehrzahl von Zeilen eines Pixelcodes 
aufweist, die gemeinsam die fur das menschliche Auge 
erkennbare und fur den menschlichen Betrachter 
unterscheidungskraf tige Information bilden . 


7. System nach einem der vorhergehenden Anspruche, 
dadurch gekennzeichnet, 
daB zwischen dem ersten Bereich (24) des 

Datentragerabschnitts (18) und dem zweiten Bereich (26) 
des Datentragerabschnitts (18) eine maschinenlesbare 
Grenzmarkierung (28) vorgesehen ist, die vorzugsweise aus 
zumindest einer Leerzeile besteht. 


8. System nach einem der vorhergehenden Anspruche, 
dadurch gekennzeichnet, 

da^ die Ref erenzmar kierung (30) einen zumindest einen der 
beiden Bereiche (24, 26) des Datentragerabschnitts (18) 
umgreifenden Rahmen aufweist. 

9. System nach einem der vorhergehenden Anspriiche, 
dadurch gekennzeichnet, 

dafi) der binare Pixelcode einer Zeile (32, 32', 32") 
jeweils eine Reihe von nebeneinanderliegenden 
Bit-Mar kierungen (34, 34', 34") der binaren Darstellung 
einer Information aufweist. 


10. System nach Anspruch 9, 

dadurch gekennzeichnet, 
daB in jeder Zeile (32, 32', 32") zusatzlich binare 
Bit-Markierungen (36, 36', 36") fiir eine Prufziffer fur 
die binare Darstellung der Information vorgesehen sind. 
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11. Verfahren zur Erkennung und Decodierung von auf einem 
optisch lesbaren Datentragerabschnitt (18) eines Systems 
gemaf^» einem der Anspruche 1 bis 10 vorgesehener 
Information, wobei die Information fur das menschliche 
Auge erkennbar und fur einen menschlichen Betrachter 
unterscheidungskraf tig ist, mit den Schritten: 

Erfassen der auf dem Datentragerabschnitt vorhandenen 
opt ischen Information; 

Auslesen der auf dem Datentragerabschnitt vorhandenen 
opt ischen Information ; 

Vergleichen der ausgelesenen Information mit einem 
gespei chert en Inf ormationsmuster und 

Erzeugen eines Authentif izeriungssignals , wenn die 
ausgelesene Information des zweiten Bereichs (26) als 
mit dem gespeicherten Inf ormationsmuster 
ubereinstimmend erkannt worden ist. 

12. Verfahren zur Erkennung und Decodierung von auf einem 
optisch lesbaren Datentragerabschnitt (18) eines Systems 
gemali einem der Anspruche 1 bis 10 vorgesehener 
Information, wobei zumindest ein Teil der Information fiir 
das menschliche Auge erkennbar und fur einen menschlichen 
Betrachter unterscheidungskraf tig ist, mit den Schritten: 

Erfassen der auf dem Datentragerabschnitt (18) 
vorhandenen opt ischen Inf ormation^- 
Identif i zieren des ersten und zweiten Bereichs (24, 
26) des Datentragerabschnitts (18); 

Auslesen und Decodieren der im ersten Bereich (24) 
enthaltenen Binarinf ormation; 

Auslesen der im zweiten Bereich (26) enthaltenen 
Information; 

Vergleichen der ausgelesenen Information des zweiten 
Bereichs (26) mit einem gespeicherten 
Inf ormationsmuster und 
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Erzeugen eines Authentif izierungssignals , wenn die 
ausgelesene Information des zweiten Bereichs (26) als 
mit dem gespeicherten Inf ormat ionsmuster 
iibereinst iimnend erkannt worden ist. 
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